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' ABSTRACT 

This report presents an evaluation of the Effective 
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High School and Pershing Intermediate School in Brooklyn, New York. 
The project served a total of 300 students of limited English 
proficiency who were native speakers of Spanish, Cantonese, Mandarin, 
or other Chinese dialects. Participating students received 
instruction in English as a Second Language (ESL) , native language 
arts (NLA), and the content area subjects of mathematics, science, 
social studies, and computer science. The project also included peer 
tutoring, career advice, staff development workshops, a parental 
advisory committee, and parent ESL classes. An evaluation of project 
ET found that it met its objectives for NLA in Cantonese, the content 
areas of mathematics, science, social studies, and computer 
education, attendance, curriculum development, career development for 
advisement, and. staff development for increased awareness of pupil 
needs. The project failed to meet its objectives for ESL, NLA in 
Spanish, career development for conferences, and staff development 
for enrollment in university courses. Three appendixes include a list 
of instructional materials used, class schedules, and a staff survey 
questionnaire. (MDM) , 
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EXECUTIVE SUMMARY 



Effective Transition (Project E.T.) was an Elementary and Secondary Education 
Act (E.S.E.A.) Title Vll-funded project in its second year of operation at Lafayette High 
School and Pershing Intermediate School of Community School District (C.S.D.) 20 in 
Brooklyn. In the year under review, Project E.T. served a total of 300 students of 
limited English proficiency (LEP) whose native language was Spanish, Cantonese, 
Mandarin, or another Chinese dialect. Participating students received instruction in 
English as a second language (E.S.L); native language arts (N.L.A.); and the content 
area subjects of mathematics, science, social studies, and computer science. Peer 
tutoring in science was an integral part of the project. Students also received 
information on career options. 

Teachers of participating students had the opportunity to attend staff 
development workshops. The project also reimbursed tuition for staff members taking 
courses on the college level. 

Project E.T. established a parental component which included E.S.L. classes, 
meetings of the Bilingual Parent Advisory Committee, and school conferences. 

Project E.T. met its objectives for N.LA. in Cantonese; the content areas of 
mathematics, science, social studies, and computer education; attendance; curriculum 
development; career development for advisement; and staff development for increased 
awareness of pupil needs and problems. The project failed to meet its objectives for 
E.S.L, N.LA. in Spanish, career development for conferences, and staff development 
for enrollment in university courses. The Office of Research, Evaluation, and 
Assessment (OREA) was unable to evaluate the objectives for dropout prevention and 
parental involvement because the project did not provide the required data. 

The conclusions, based on the findings of this evaluation, lead to the following 
recommendations: 

• Consider offering intensive E.S.L. on the literacy level at Lafayette High 
School, particularly for recent immigrants. 

• Assess reasons for the lack of growth in participants' acquisition of skills 
in Spanish N.LA. Consider initiating intensive training for the peer-tutors. 

• Plan career conferences with enough lead time to guarantee site 
availability. 

• Explore reasons why staff members did not attend university courses to 
increase their skills in bilingual education. 

• Provide complete data so that OREA can effectively evaluate all objectives. 
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I. INTRODUCTION 



This report documents the Office of Research, Evaluation, and Assessment's 
(OREA's) evaluation of the Elementary and Secondary Education Act (E.S.E.A.) Title VII- 
funded project, Effective Transition (Project E.T.), in its second year in 1992-93. 

PROJECT CONTEXT 

Project E.T. operated at Lafayette High School and Pershing Intermediate School 
in Community School District (C.S.D.) 20 in Brooklyn. The population in the community 
surrounding Pershing Intermediate School was mainly Latino and Asian-American, with 
a small number of European-Americans. The neighborhood was a mixture of middle- 
and low-income residents. The community surrounding Lafayette High School was 
mainly European-American (Italian), with a small number of Asian-American and 
Latinos, and was predominantly middle-income. 

At Pershing Intermediate School, 1,547 students were registered in the 1991-92 
school year (the last year for which this information was available). Fifty-eight percent 
were Latino, 21 percent were Asian-American, 16 percent were European-American, 
and 5 percent were African-American. Twenty-four percent of these students were of 
limited English proficiency (LEP), and 71 percent came from low-income families, as 
evidenced by their eligibility for the free-lunch program. 

Of the 2,680 students who registered at Lafayette High School, 35 percent were 
African-American, 31 percent were European-American, 19 percent were Latino, and 15 
percent were Asian-American. Sixteen percent of these students were LEP and 39 
percent came from low-income families. 
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Both Pershing Intermediate School and Lafayette High School were housed in 
older buildings. The former was constructed ir 1925 and the latter in 1939. 
Classrooms at Pershing Intermediate School needed repairs to their floors and window 
shades, general cleaning, and additional desks and chairs. Classrooms and hallways 
were overcrowded. Classrooms at Lafayette High School were well-lit and decorated 
with maps and multicultural posters, but student work was not in evidence. 

STUDENT CHARACTERISTICS 

Project E.T. served LEP students in sixth through twelfth grade whose native 
languages were Spanish, Cantonese, Mandarin, or another Chinese dialect. Scores at 
or below the 40th percentile on the Language Assessment Battery (LAB) determined 
LEP status. Other student characteristics considered by the project were low native 
language literacy, as determined by review of academic records and teacher 
recommendations, and willingness to participate, as determined by personal interviews 
and the written permission of parents. See Table 1 for enrollment by grade levels. 

TABLE 1 

Number of Students in Project E.T., by Grade and Site 



I Site 


Grade 


Total 


6 


7 


8 


9 


10 


11 


12 


1 Pershing 
Intermediate School 


60 


32 


58 










150 


Lafayette High 
School 








40 


53 


42 


15 


150 



The project served a total of 300 students; male students numbered 142 (47.3 
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percent) and female 158 (52.7 percent). Students whose native language was Spanish 
numbered 79 (26.3 percent); those whose native language was Cantonese numbered 
198 (66 percent). Students whose native language was Mandarin numbered 11 (3.7 
percent), and those whose spoke another Chinese language numbered 12 (4.0 
percent). The majority of participants (57.7 percent) were born in China. The next 
largest group (10.3 percent) was from Hong Kong. (See Table 2 for countries of 
origin.) Most (93.3 percent) of the participants came from low-income families, as 
evidenced by their eligibility for the free-lunch program. 
Needs Assessment 

Before initiating programming, the projsct conducted a needs assessment of the 
targeted students and their families and of the educational staff who were to serve 
them. The data obtained from these studies indicated four primary needs: 
(1) to provide LEP students with intensive English and native language instruction and 
support services to improve their school performance; (2) to provide bilingual 
instruction in college and career orientation; (3) to offer staff development activities to 
heighten teachers' awareness of the needs and problems of LEP students and to 
improve their skills and effectiveness as bilingual educators; and (4) to obtain more 
effective articulation between intermediate and senior high schools. 
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TABLE 2 
Students' Countries of Origin 



— 

Country 


iNurnD6r ot oxuggnis | 


China 


173 | 


Hong Kong 


31 ij 

— ,j 


Dominican Republic 


20 


Mexico 


15 


United States 


15 


Puerto Rico 


10 


Honduras 


5 


Vietnam 


4 


Argentina 


3 


Ecuador 


3 


Guatemala 


3 


Other 


9 


Unreported 


9 


Total 


300 I 



PROJECT OBJECTIVES 
Student Objectives 

• As a result of participation, 70 percent of the target students will 
demonstrate an appropriate increase in English language proficiency as 
indicated by significant improvement at the .05 level of statistical 
significance when results are analyzed using a correlated t test. 

• As a result of participation, 70 percent of the students will demonstrate a 
significant increase in Spanish language achievement as indicated by 
significant improvement at the .05 level of statistical significance when 
results on a pre- and posttest of El Examen de Lectura en Espanol (ELE) 
are analyzed using a correlated t test. 
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• As a result of participation in the program 70 percent of the Cantonese- 
speaking students will demonstrate a significant increase in native 
language achievement by scoring at or above 65 in final course grades. 

• As a result of participation, 70 percent of all targeted students will score at 
or above the passing criterion of 65 in the content area subjects of social 
studies, mathematics, science, and computer education. 

• As a result of participation, students' attendance will be significantly higher 
than that of mainstream students. 

• Program students will have a significantly lower dropout rate than similar 
non-program students. 

Career Development Objectives 

• All graduating students will meet with the bilingual resource specialists, 
bilingual grade advisors, or bilingual guidance counselors for advisement 
at least three times during the school year. 

• The program will organize at least one conference for students in which 
representatives of business and industry will present information on 
math/science/computer options and skill requirements. 

Staff Development Objectives 

• As a result of participation, 80 percent of program staff will demonstrate an 
increase in awareness of pupil needs and pupil problems as indicated by 
a 5-point scale of problems and needs inventory, tabulating and 
ascertaining percentage of change. 

• As a result of participation, 50 percent of program staff members will enroll 
in at least one university course each semester. 

Curriculum Development Objectives 

• By the second and third years (1993 and 1994), the curriculum specialists 
will have developed or translated one subject matter-oriented instructional 
guide for teaching (for either native language arts, math science, social 
studies, or computer science) each year. 

• By the first, second, and third years (June 1992, 1993, and 1994), the 
project staff will have completed at least ten science modules each year to 
be used in the peer tutoring component. 

5 
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Parental Involvement Objective 

• The proportion of program students' parents who participate in Open 
School Day/Evening will be equal to or greater than the proportion of 
mainstream students' parents who participate in this activity. 

PROJECT IMPLEMENTATION 

During the 1992-93 school year, Project E.T. provided instructional and support 
services to 300 Spanish-, Cantonese-, and Mandarin-speaking students and their 
families. The project's main goals were to offer newly-arrived bilingual students 
programming in order to improve the articulation between intermediate and high school 
and to promote the acquisition of language and content area skills in LEP students. 

At Lafayette High School, only Cantonese- and Mandarin-speaking students 
received instruction in their native language in the content areas. The resource 
specialist reported that Spanish-speaking students were placed in mainstream content 
area courses because there were insufficient numbers to form bilingual classes. 

Cantonese- and Mandarin-speaking students at Lafayette High School were 
offered content area courses five periods a week using English and the native language 
in varying proportions: sequential mathematics, global history, economics, and 
physical science were taught in Cantonese or Mandarin 60 percent of the time, human 
biology, applied chemistry, and industrial arts technology were taught in Cantonese or 
Mandarin 70 percent of the time. 

At Pershing Intermediate School, mathematics, science, and social studies 
classes were taught using English supplemented by either Cantonese or Spanish in five 
out of six sections. One section of each content area course was taught exclusively in 
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the students' native language. The computer education course was taught exclusively 
in English. Project E.T. did not provide information on the relative instructional time in 
the students' native language and English for content area courses. 

Peer-tutoring sessions in science at Pershing Intermediate School for both 
Chinese and Latino students used the students' native language 80 percent of the time. 
At Lafayette High School, the training of Chinese-speaking peer tutors was in 
Cantonese 80 percent of the time, while training for Spanish-speaking peer tutors was 
in English 100 percent of the time. Each met for two periods per week. 

Project E.T. offered in-service staff development and parental involvement 
activities. The project also provided reimbursement to staff for college credits. 
Materials. Methods, and Techniques 

Project E.T. offered English as a second language (E.S.L.) on the literacy, 
beginning, intermediate, advanced, and transitional levels at Pershing Intermediate 
School, and at the beginning, intermediate, advanced and transitional levels at 
Lafayette High School. The project offered native language arts (N.L.A.) on a literacy to 
advanced placement level at Pershing Intermediate School and on a literacy to 
advanced level at Lafayette High School. The project did not indicate which languages 
were offered at each level. 

Teachers of participating students used a wide array of strategies and 
techniques, including total physical response, pattern drills, peer tutoring, story-telling, 
the cloze procedure, and hands-on experiments. Audiovisual aids supplemented 
classroom instruction. 

7 
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An innovative feature of the project was its peer tutoring component, the goal of 
which was to increase student motivation and performance by narrowing the gap 
between high school and intermediate school. Project students from Lafayette High 
School traveled bi-monthly to Pershing Intermediate School to offer hands-on science 
workshops to younger project students, using staff-developed modules in Chinese and 
Spanish. Project E.T. developed 16 science modules in English this year, and the 
resource specialist translated 15 of them into Chinese. 

For a list of instructional materials used in the project, please see Appendix A. 
Capacity Building 

Participating sites will gradually contribute toward the purchase of most materials 
and supplies and the cost of the Title VII staff. During the third year of the project, tax 
levy funds will pay 40 percent of a resource specialist's salary, 20 percent of the cost of 
materials and supplies, and 70 percent of the cost of E.S.L textbooks. At the end of 
the third year of the project, the sites plan to assume the total cost of programming. 
Staff Qualifications 

Title VII staff . The project director was fully funded and two resource specialists 
were partly funded by Title VII. For a description of their degrees and language 
proficiency (teaching or communicative*), see Table 3. 

The project director's responsibilities included supervision and administration of 



♦Teaching proficiency (TP) is defined as the ability to use LEP students' native 
language in teaching l«\nguage arts or other academic subjects. Communicative 
proficiency (CP) is defined as a non-native speaker's basic ability to communicate and 
interact with students in their native language. 
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the project and provision of evaluation data. The resource specialists' responsibilities 
were to provide on-site coordination and supervision of both the project and the peer- 
tutoring component, act as liaison with the project office, provide support services to 
the bilingual education staff, advise students, communicate with the parents of project 
students, and establish a Parent Advisory Committee (PAC). 



TABLE 3 
Project Staff Qualifications 



Position Title 


Degree (s) 


Language Competence 


Project Director 


Ph.D 


Spanish (TP) 


Resource Specialist 


M.S. 


Cantonese (TP) 
Mandarin (TP) 


Resource Specialist 


not provided 


Cantonese (TP) 
Mandarin (TP) 



Other staff . Tax-levy funds paid the salaries of the 41 classroom teachers who 
provided instructional services to project students. Eight teachers were TP and two CP 
in Spanish, 13 were TP in Chinese. Six were TP and three CP in other languages. 
Thirty-five teachers held master's degrees and five held bachelor's degrees. The 
project did not provide OREA with information on one of the teacher's degrees. Thirty- 
three of the 41 teachers had training in either bilingual education or E.S.L. Twenty-two 
teachers held high school certification in the subject area they taught; one teacher of 
E.S.L. held an ancillary E.S.L. certificate. All intermediate school teachers held 
appropriate certification in either the subject area they taught or in common branches. 
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Staff development . Four teachers received tuition assistance toward college 
courses in E.S.L or bilingual education during the fall semester, and one received 
tuition assistance during the spring semester. During the fall semester, the project 
director, two resource specialists, and occasionally an assistant principal met regularly 
to discuss the administration of the project; the project director met once with two 
curriculum developers to discuss the development of the science modules. During the 
spring semester, eight teachers working with Chinese project students at Pershing 
Intermediate School met every two weeks to discuss bilingual education. The resource 
specialist at Lafayette High School attended workshops on bilingual science classroom 
activities and enhancing the Chinese student's participation in the classroom. 
Instructional Time Spent on Particular Tasks 

See Appendix B for examples of class schedules for Pershing Intermediate 
School. The project did not provide class schedules for Lafayette High School. 
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Length of Time Participants Received Instruction 

Students had a mean of 5.2 years (s.d.=2.9) of education in a non-English- 
speaking school system and 2.9 years (s.d. = 1.6) of education in the United States. 
The median time students participated in Project E.T. was 10 months. 
Activities to Improve Pre-referral Evaluation Procedures 

Teachers referred those students thought to be in need of special education 
services to the School-Based Support 14am (S.B.S.T.) for evaluation. The S.B.S.T. at 
Pershing Intermediate School had one social worker who was proficient in Spanish and 
one who was proficient in a Chinese language. The S.B.S.T. at Lafayette High School 
had no members bilingual in Spanish or Chinese, and other staff translated as 
necessary. 

Gifted and talented students were identified by teacher judgment and 
course grades. 

PARENT AND COMMUNITY INVOLVEMENT ACTIVITIES 

Project E.T. proposed to publish and disseminate a monthly bilingual newsletter 
but provided OREA with no information on its implementation. The project director 
reported that the proposed parent program in E.S.L. and general equivalency diploma 
(G.E.D.) skills operated only at Lafayette High School, because Pershing Intermediate 
School did not have funds to hire a custodian to cover evening and weekend events. 
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II. EVALUATION METHODOLOGY 



EVALUATION DESIGN 

Project Group's Educational Progress as Compared to That of an Appropriate 
Non-Proiect Group 

OREA used a gap reduction design to evaluate the effect of language instruction 
on project students' performance on standardized tests. Because of the difficulty in 
finding a valid comparison group, OREA used instead the groups on which the tests 
were normed. Test scores are reported in Normal Curve Equivalents (N.C.E.s), which 
are normalized standard scores with a mean of 50 and a standard deviation of 21.1. It 
is assumed that the norm group has a zero gain in N.C.E.s in the absence of 
supplementary instruction and that participating students' gains are attributable to 
project services. 

Applicability of Conclusions to All Persons Served bv Project 

Data were collected from all participating students for whom there were pre- and 
posttest scores. (There were no pretest data on students who entered the program 
late; therefore, posttest data for them will serve as pretest data for the following year.) 
Instruments used to measure educational progress were appropriate for the students 
involved. The LAB and El Examen de Lectura en Espanol (ELE) are used throughout 
New York City to assess the growth of English and Spanish skills in populations similar 
to those served by Project E.T. 
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INSTRUMENTS OF MEASUREMENT 

OREA compared pre- and posttest scores on the LAB to assess the E.S.L 

objective and the ELE to assess the Spanish N.L.A. objective. The Cantonese N.L.A. 

objective was assessed through course grades. The content area objective in 

mathematics, science, social studies, and computer education also was assessed 

through course grades, as specified. 

All students were tested at the appropriate grade level. The language of the LAB 

and ELE was determined by the test itself. 

According to the publishers' test manuals, all standardized tests used to gauge 

project students' progress are valid and reliable. Evidence supporting both content 
and construct validity is available for the LAB. Content validity is confirmed by an 
item-objective match and includes grade-by-grade item difficulties, correlations between 
subtests, and the relationship between the performance of students who are native 
speakers of English and students who are LEP. To support reliability, the 
Kuder-Richardson Formula 20 (KR20) coefficients and standard errors of measurement 
(SEM) are reported by grade and by form for each subtest and total test. Grade 
reliability coefficients, based on the performance of LEP students on the English 
version, ranged from .88 to .96 for individual subtests and from .95 to .98 for the total 
test. 

The ELE was prepared by New York City educators who were native speakers of 
Spanish and represented several Latino linguistic and cultural groups. The ELE was 
administered in two forms to all New York City students who were receiving language 
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arts instruction in Spanish. For Form 1 , the grade reliability coefficients ranged from 
.94 to .96. Comparable data for Form 2 will be generated as soon as possible after its 
administration in the spring of 1993. Items on the test were grade-specific. Construct 
validity is evidenced by grade-to-grade decreases in item difficulty within level. This 
characteristic reflects the acquisition of increased amounts of the underlying construct 
(reading proficiency) as students progress through the grades. 

To assess the objectives for the ongoing education of teachers, OREA examined 
transcripts from the institution in which the staff members enrolled. OREA also 
developed and distributed Likert-type evaluation questionnaires for teachers to rate the 
quality, relevance, and usefulness of staff development activities (see Appendix C). 

OREA used information on career advisement and career conference activities 
provided by the project director to evaluate the career development objectives. 

To assess the curriculum development objectives, OREA used information 
provided by the project director on the development of science modules and their 
translation into Chinese. 

In order to assess the parental involvement objectives, OREA used information 
provided by the. project director on attendance at Open School Day/Evening. 

DATA COLLECTION AND ANALYSIS 
Data Collection 

To gather qualitative data, an OREA evaluation consultant carried out on-site and 
telephone interviews of the project director several times during the school year and 
also observed two classes on each of two visits. The project evaluator collected the 
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data and prepared the final evaluation report in accordance with the New York State 
E.S.E.A. Title VII Bilingual Education Final Evaluation Report format, which was adapted 
from a checklist developed by the staff of the Evaluation Assistance Center (EAC) East 
in consultation with the Office of Bilingual Education and Minority Language Affairs 
(OBEMLA). 

Proper Administration of Instruments 

Qualified personnel received training in testing procedures and administered the 
tests. Test administrators followed guidelines set forth in the manuals accompanying 
standardized tests. Time limits for subtests were adhered to; directions were given 
exactly as presented in the manual. 
Testing at Twelve-Month Intervals 

Standardized tests were given at 12-month intervals, following published 

norming dates. 
Data Analysis 

Accurate scoring and transcription of results . Scoring, score conversions, and 
data processing were accomplished electronically by the Scan Center of the Board of 
Education of the City of New York. Data provided by the Scan Center were analyzed in 
the Bilingual, Multicultural, and Early Childhood Evaluation Unit of OREA. Data 
collectors, processors, and analysts were unbiased and had no vested interest in the 
success of the project. 

Use of analyses and reporting procedures appropriate f or obtained data. To 
assess the significance of students' achievement in English and Spanish, OREA 
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computed a correlated f-test on the LAB and ELE scores. The t-test determined 
whether the difference between the pre- and posttest scores was significantly greater 
than would be expected from chance variation alone. 

The only possible threat to the validity of any of the above instruments might be 
that LAB norms were based on the performance of English Proficient (EP) rather than 
LEP students. Since OREA was examining gains, however, this threat was 
inconsequential — the choice of norming groups should not affect the existence of gains. 
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III. FINDINGS 



PARTICIPANTS' EDUCATIONAL PROGRESS 
Participants' Progress in English 

Throughout the school year, students had ample opportunity to develop their 
English language skills. 

The evaluation objective for English as a Second Language was: 

• As a result of participation, 70 percent of the target students will 
demonstrate an appropriate increase in English language proficiency as 
indicated by significant improvement at the .05 level of statistical 
significance when results are analyzed using a correlated t test. 

There were complete pre- and posttest scores on the LAB for 251 students from 
grades six through twelve. (See Table 4.) The mean gain of 5.7 N.C.E.S (s.d.=9.7) was 
statistically significant (p<.05), but only 59 percent of the students showed a gain. 

Project E.T. did not meet its objective for English as a second language. 

Participants' Progress in Native Language Arts 

There were two evaluation objectives for N.L.A., one for Spanish and one for 
Cantonese. 

• As a result of participation, 70 percent of the students will demonstrate a 
significant increase in Spanish language achievement as indicated by 
significant improvement at the .05 level of statistical significance when 
results on a pre- and posttest of El Examen de Lectura en Espanol (ELE) 
are analyzed using a correlated t test. 

There were complete pre- and posttest scores on the ELE for 43 students, all 
from Pershing Intermediate School. The mean pretest score of 52.9 (s.d.= 19.6) and 
posttest score of 49.8 (s.d.= 21.6) yielded a loss of 3.16 (s.d. = 13.1). 

Project E.T. did not meet its N.L.A. objective in Spanish. 
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• As a result of participation in the program 70 percent of the Cantonese- 
speaking students will demonstrate a significant increase in native 
language achievement by scoring at or above 65 in final course grades. 

Over 80 percent of the students passed their Chinese N.LA. courses both 
semesters. (See Table 5.) 

Project E.T. met its N.L.A. objective in Cantonese. 
LEP Participants' Academic Achievement 

Teachers at Pershing Intermediate School used English supplemented by 
Spanish or Cantonese in content area classes, except for computer education, which 
was taught in English using an E.S.L. methodology. At Lafayette High School, 
instruction was in Cantonese and Mandarin; Spanish-speaking students were placed 
in mainstream content area courses. Teachers used a wide array of strategies and 
techniques, including cloze procedures, hands-on experiments, and peer tutoring. 

TABLE 5 



Passing Grades in Native Language Arts (Cantonese), by Site 



Site 


Fall 1992 


Spring 1993 


Number of 
students for 
whom data 
were reported 


Percent 
Passing 


Number of 
students for 
whom data 
were reported 


Percent 
Passing 


Pershing Intermediate School 


77 


80.5 


78 


96.2 


Lafayette High School 


96 


86.5 


50 


94.0 


Total 


173 


83.8 


128 


95.3 



• The percentage of students passing their Chinese 
N.LA. courses was higher in the spring than in 
the fall. 
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The OREA evaluation consultant observed a seventh and eighth grade 
bilingual science class; part of the peer tutoring component at Pershing Intermediate 
School. Thirty-seven project students were crowded into a dirty classroom with 
broken floor tiles and torn window shades. The room did not have enough desks 
and chairs to accommodate all the students. A high school student leader explained 
in Spanish the scientific basis for seasonal changes. She used a styrofoam ball and 
light to demonstrate the rotation of the Earth on its axis and its revolution around the 
sun. Students conducted the experiment themselves after dividing into four groups. 
They appeared enthusiastic and highly motivated. Other high school student leaders 
answered, in both Spanish and English, the groups' questions about the experiment 
and the lesson handout. Later, the student leaders showed a film depicting the 
Earth's movement around the sun. 

The OREA evaluation consultant observed a bilingual social studies class of 
16 Cantonese-speaking project and non-project students at Lafayette High School. 
The classroom walls were decorated with posters describing the American 
government system and maps of the world and Southeast Asia. The lesson was 
about the political boundaries of Southeast Asia. The lesson was teacher-directed 
and used a content-based instructional methodology for language learning. The 
teacher named in English and Cantonese the countries and capitals of Southeast 
Asia. The class repeated them in English, then colored in the countries on their map 
handout. Later, the class read aloud in English from a handout on the geography, 
history, and cultures of Southeast Asia, then translated what was said into 
Cantonese. 

20 
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The content area was: 

As a result of participation, 70 percent of all targeted students will score at 
or above the passing criterion of 65 in all the content area subjects of 
social studies, mathematics, science, and computer education. 

Well over 70 percent of the project students passed each content area course 
each semester. (See Table 6.) 

Project E.T. met its objective for the content area subjects of mathematics, 
science, and computer education. 

FORMER PARTICIPANTS' PROGRESS IN ENGLISH LANGUAGE CLASSROOMS 
The project did not provide OREA with data on former project students. 

OVERALL EDUCATIONAL PROGRESS ACHIEVED^HROUGH PROJECT 

Career Development Outcomes 

The project proposed two career development evaluation objectives: 

All graduating students will meet with the bilingual resource specialists, 
bilingual grade advisors, or bilingual guidance counselors for advisement 
at least three times during the.school year. 

The resource specialists, grade advisors, and guidance counselors at the two 
sites advised graduating project students on career and educational options. In 
addition, books and pamphlets in English and Chinese regarding New York City public 
high schools were made available to Pershing Intermediate School students. 

All graduating students met with the bilingual resource specialists, bilingual 
grade advisors, or bilingual guidance counselors for advisement at least three times 
during the school year. 

The project met its career development objective for advisement. 
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• The program will organize at least one conference for students in which 
representatives of business and industry will present information on 
math/science/computer options and skill requirements. 

The project director reported that difficulties in scheduling at Long Island 

University's Brooklyn campus prevented a career conference from being organized in 

the year under review. He indicated that the project planned to hold such a conference 

in the fall. 

The project did not meet its career development objective for career 
conferences. 
Grade Retention 

Project E.T. did not propose any objectives for grade retention. One of the 
participating students (0.3 percent) was retained in grade. 
Dropout Prevention 

Project E.T. proposed the following dropout prevention objective: 

• Program students will have a significantly lower dropout rate than similar 
non-program students. 

No project students dropped out of Pershing Intermediate School; two project 
students (0.7 percent) dropped out of Lafayette High School. The project did not 
provide OREA with information on the schoolwide dropout rates. 

OREA was unable to evaluate the objective for dropout prevention. 




Attendance 

The reading material and computer offered in the resource room were of interest 
to students and helped encourage attendance at Pershing intermediate School. Staff 
regarded the peer-tutoring component as having served as another avenue for 
increasing student attendance. 

The project had one attendance objective: 

• As a result of participation, students' attendance will be significantly higher 
than that of mainstream students. 

At Pershing Intermediate School, the attendance rate for project students was 
95.8 percent, while the schoolwide rate was 88.7 percent. At Lafayette High School, 
the attendance rate for project students was 98.3 percent, while the schoolwide rate 
was 80.1 percent. (Both schoolwide rates are for 1991-92, the last year for which data 
are available.) The overall attendance rate for project students was 97 percent (based 
on 285 students), while the total school attendance was 84.4 percent. The rate for 
participating students was 12.6 percent higher than that of the total school population. 
This difference was significant (p<.05). 

Project E.T. met its attendance objective. 
Placement in Gifted and Talented Programs 

Students at Pershing Intermediate School showing potential were eligible to 
enroll in a computer science course to learn various software programs. At Lafayette 
High School, students showing ability in science were encouraged to do special 
projects and referred to summer research programs. 

No students were placed in a program for the gifted and talented. 
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Enrollment in Post-secondary Education Institutions 

Five graduating seniors indicated that they would be enrolling in post-secondary 
educational institutions upon graduation. 

CASE HISTORY 

Z was in the eleventh grade at Lafayette High School. He had emigrated to the 
United States from Hong Kong four years previously. He worked in a restaurant after 
school to supplement the family income. Both his employment record and academic 
studies reflected his dedication, but his grades were poor. In the project, he sought 
out and received extra help from the resource specialist and he made great strides in 
his studies. 

STAFF DEVELOPMENT OUTCOMES 

The project proposed two staff development evaluation objectives: 

• As a result of participation, 80 percent of program staff will demonstrate an 
increase in awareness of pupil needs and pupil problems as indicated by 
a 5-point scale of problems and needs inventory, tabulation and 
ascertaining percentage of change. 

Project E.T. distributed an OREA-designed Likert-type evaluation questionnaire to 
44 teachers and project staff members at the end of the school year. OREA received 
20 completed questionnaires. (See Appendix C.) Eighty-five percent of the 
respondents indicated a heightened awareness of pupils' needs and problems and 
rated the project's quality as superior. 

Project E.T. met its staff development objective for increased awareness of pupils 
needs and problems. 
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• As a result of participation, 50 percent of program staff members will enroll 
in at least one university course each semester. 

One resource specialist and three teachers completed university courses in the 

fall semester, and one resource specialist completed a university course in the spring 

semester. 

The project did not meet its staff development objective for enrollment in 
university courses. 

CURRICULUM DEVELOPMENT OUTCOMES 

Project E.T. proposed two curriculum development evaluation objectives: 

• By the second and third years (1993 and 1994), the curriculum specialists 
will have developed or translated one subject matter-oriented instructional 
guide for teaching (for either native language arts, math, science, social 
studies, or computer science) each year. 

In the year under review, the resource specialists translated 15 science modules 
into Chinese. 

The project met its curriculum development objective for instructional guides. 

• By the first, second, and third years (June 1992, 1993, and 1994), the 
project staff will have completed at least ten science modules each year to 
be used in the peer tutoring component. 

The resource specialists developed 16 science modules in the year under review. 
The project met the objective for developing science modules. 
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PARENTAL INVOLVEMENT OUTCOMES 

Parent E.S.L classes were offered every Tuesday and Thursday evening at 
Lafayette High School. A parent advisory council (PAC) met four times during the 
school year. Sixty parents of project students attended a festival that included ethnic 
foods, costumes, music, and dancing. 

Project E.T. proposed the following parental involvement evaluation objective: 

• The proportion of program students' parents who participate in Open 
School Day/Evening will be equal to or greater than the proportion of 
mainstream students' parents who participate in this activity. 

Parents received written notification in their home language of Open School 
Day/Evening. The resource specialist at Lafayette High School also telephoned many 
Chinese-speaking parents, and reminded Spanish-speaking students to speak to their 
parents about the event. Attendance records, however, were not kept. 

The project did not supply OP.'-*\ with data to evaluate its parental involvement 
objective. 
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IV. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 

ACHIEVEMENT OF OBJECTIVES 

Project E.T. met its objectives for N.LA. in Cantonese; the content areas of 
mathematics, science, social studies, and computer education; career advisement; 
attendance; staff's increased awareness of pupil problems and needs; and curriculum 
development. The project failed to meet its objectives for E.S.L, Spanish N.L.A., career 
conferences, and staff enrollment in university courses. OREA was unable to evaluate 
the objectives for dropout prevention and parental involvement, because the project did 
not provide the required data 

Participating students in Project E.T. achieved academic success. Of the 300 
participating students in grades six through twelve, 299 were promoted to the next 
grade. Over half (59 percent) of the participating students showed significant gains in 
English as measured by gains on the LAB. Students showed appreciable gains in 
Chinese N.LA. and the content areas. 

Project services increased the students' understanding of the significance of 
education. The attendance rate of the project students was considerably higher than 
the schoolwide rate. Additionally, all graduating project students met with the bilingual 
resource specialist, grade advisor, or guidance counselor to discuss career and 
education options at least three times during the school year. Unfortunately, students 
did not have the opportunity to attend a career conference as the project had 
proposed. 

28 



While only a few participating staff members attended graduate courses to 
increase their knowledge of bilingual education and provide better services for the 
students, most reported that the project had increased their understanding of the needs 
and problems of LEP students. Project staff developed and translated into Chinese 
many science modules for the peer tutoring component of the project. 

MOST AND LEAST EFFECTIVE COMPONENTS 

Highly effective components of Project E.T. were the peer tutoring in science, 
Cantonese N.L.A., and the curriculum development component. Quantitative data, 
reports of observers, and the feedback from those administering the program attested 
to the strength shown in these areas. 

The least effective component of the project was Spanish N.LA. 

RECOMMENDATIONS TO ENHANCE PROJECT EFFECTIVENESS 

• Consider offering intensive E.S.L on the literacy level at Lafayette High 
School, particularly for recent immigrants. 

• Assess reasons for the lack of growth in participants' acquisition of skills 
in Spanish N.LA. Consider initiating intensive training for the peer-tutors. 

• Plan career conferences with enough lead time to guarantee site 
availability. 

• Explore reasons why staff members did not attend university courses to 
increase their skills in bilingual education. 

• Provide complete data so that OREA can effectively evaluate all objectives. 



29 

39 



APPENDIX A 
Instructional material, cont'd 



E.S.L 



Grade 


Title J 


Author 


Publisher 


Date of Publication 


Beginning & 
Intermediate 


Side by Side Text & 

Workbook 1A. 2A. 2B 


Molinsky & Bliss 


Prentice Hail 


1983 


Beginning & 
intermediate 


Line by Una 

1A. 1B. 2A. 2B 


Molinsky & Bliss 


Prentice Hall 


1983 


Beginning. 
Intermediate. & 
Advanced 


Grammar Work 
1.2. 3.4 


P. Breyer 


Prentice Hail 
Regents 


1982 


Beginning & 
Intermediate 


Skill Sharpeners 
1. 2. 3, 4 


DeFiiippo & Skiamore 


Addison* Wesley 


1984 


Beginning & 
Intermediate 


English with a Smile 


Zaffran A Kulik 


National Textbook Co. 


1985 


Transitional 


Stories We Brought With Us 


Kasser & Silverman 


Prentice Hall 


1986 


Advanced 
Transitional 


Great American Stories 1. 2 


C.G. Draper 


Prentice Hall 


1985 


Advanced 
TranertionaJ 


Modern Curriculum 
Literature 


Frank & Hutching 


Modern Curriculum 
Press 


1987 


Advanced 


Littie Stories for Big People 


Gonshack 


Prentice Hall Regents 


1976 


Beginning* 
Advanced 


World of Vocabulary 


Rauch & Weinatein 


Global Books 


1981 


10th 


Easy Reading Selections in 
English 


Dixon 


Prentice Hall Regents 


1984 


10th 


Turning Points 2 


lantorno & Papa 


Addison & Wesley 


1986 


10-11 


Turning Points 3 


I an tor no & Papa 


Addison & Wesley 


1989 


10-12 


Sherlock Holmes 


Conan Ooyle 


Globe Books 


1987 


• 


Resource Book for 
Teachers 


Morgan & Rinvoiucri 


Oxford 


• 


• 


Techniques in Teaching 
Vocabulary 


French Allen 


Oxford 


• 


* 


Learning Purpose and 
Language Use 


Widdowson 


Oxford 


• 



•Not supplied by project 
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APPENDIX A 



Instructional material, cont'd 



yriot 




Anther 


Puhli^t*r 
ruu iisnvv 


Data of 

Publication 


• 


Using WhatWa Know 
About Laarning 


Association for 
Supervision and 
Curriculum Davaiopmant 


Hoaford 


• 




Oxford Bamantary 
iNrmr't Dictionary of 
English 


Burridga 


uxTora 






wXTOfu oTUGSni 9 UtCaOrwy 

of Currant English 


nornuy 








Spaaking Up at Work 


• 


Oxford 


• 





A Laaxnar's Dictionary of 
English Idioms 


iyicwcuq <■ rvicu i»*r 








Practics with Idioms 




Oxford 




• 


Oxford Dicitionary of 

/^i imam* 1 r J I mtin CimISaU 

ourrant lotomaoc cngnsn, 
V.2 


Cowia. Mackin & McCaig 


Oxford 






Tha Grammar Handbook 


Faiganbaum 


Oxford 






Tachniquaa and Rasourcat 
in Taaching Grammar 


Catca-Murcia & Hillas 


Oxford 






A Basic English Grammar 


Eastwood & Mackin 


Oxford 






Critical Raading & Writing 
for Advancad E.S.L 
Stud ants 


Scull 


Prantica Hall 
Ragants 




Intarmadiata 


Yaatarday and Today in tha 
U.SA 


Harris Uva 


Prantica Hall Ragants 


• 



•Not supplied by project 



31 



APPENDIX A 
Instructional material, cont'd 
N.LA. 



Grada 


Utto 


Author 


Pubiishar 


Data of Publication 


6-7 


StofiM from Classical 
Allusion 


Pang, Minghui 


Ovarsaas Chinasa 

Library 


1987 


6 


Chinasa Fablas 


Tung, Chung-Ssu 


Ovarsaas Chinasa 

Library 


1986 


6-8 


Chinasa Hafitag and 
Cultura Rasourca Manual 


Division of Bilingual 
Education 


Naw York City Board of 
Education 


• 


6-8 


Chinasa- Am aricans: Unity 
Through Divarsrty 


* 


Naw York City Board of 
Education 


* 


6-8 


Old Traditions, Naw 
Oiractions 


* 


Naw York City Board of 
Education 




6-8 


Bilingual Rasourca Library 
of Chinasa Educational 
Rasourcaa and Cultural 
Matariais 


Division of Bilingual 
Education 


Naw York City Board of 
Education 


• 


6*8 


Asian and Pacific Island 
Curricula/ Matariais and 
Prof— ioftfll Dav*loorrwrt 

Matariais 


* 


EDAC-LA Catalog ua 


* 


6 


Chinasa L.A. 


Dapartmant of Education 
Taiwan 


Rs public of China 


1975 


fi-ft 


SoAnish is Pun. 1 2 

W^W*tl*4l 19 1 Will 't tm 


Haywood Wald 


Am sco 


1991 


# 


Pa Alidad Pant— tm 

Utaratura y Arta 


* 


Holt, Rsinhait & 
Winston 


• 


6 


Lsyandaa l^noamaricanaa 


* 


National Taxtbook 


• 


O 




* 


National Taxtbook 


* 


10 


Writing Manual 


Yumin Ba, at.al. 


China Publishing Co. 


1991 


12 


Activa Laaming: 
Raading & Writing 


Wanhua U, at. al 


China Publishing Co. 


1992 


9-10 


Chinasa Lang uaga Art 


Byonghya Chang 


Dissaminational 
Assassmsnt Cantar 


1993 


Beginning 


Layandas Latir>oamaricanaa 


Ganaviava Bartow 


National Taxtbook Co. 


1991 


9-12 


Convarsar Sin Parar 


Gaorga Routaa 


* 


1962 


9-12 


Capuraata an Manhattan 


Carmin Martin Garta 


Edicionas Siruala 
Madrid 


1990 


Irrtarmadlata 


Taatro Modarno Hispanico 


Nina Laa Waisingar (ad.) 


National Taxtbook 


1992 
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APPENDIX A 
Instructional material, cont'd 
Mathematics 



Grada 


Trtto 


Author 


Publishar 


Data of 

Publication | 


©*o 


Forasman Math 


l. varay 00151 ar 




1 900 I 




CXJlO 9C\ IM MtWIIIQwW 




fiilw Ri irrl«tt 

WllVH DUlQVU 


1983 I 




Building Skill* in Mathamatics, Tan, 
Purpta, Rad 


* 


Marrit Basic Skills 




6*8 


Mathamatics for Today. Graan 


• 


Sadliar-Oxford 


• 


6*8 


Workbook for Naw Prograas in 
Mathamatics, Graan 


• 


Sadllar-Oxford 


• 




Stud ant Workbook to Accompany Basic 
Mathamatics Skills 




Madia Matarials. Inc. 




6*8 


Math Mastary 


Evans 


Wast Saa Pub Co. 




6*8 


Aftarmath. Ill 




Craativa Publications 


• 


6*8 


rracocaJ Matnamanca 


Dm** A. Dam 

noss <fc noss 


rOClDv ~lWmm 




6*8 


Ufa Skills Math 


Mosanfald ar 


Education Daaign. Inc. 




6*8 


Math: For tha World of Work 


CrowaH 


Education Daaign. Inc. 




6*8 


Consumar Mathamatics Workbook 


Langa 


Houghton-Mifflin 




6*8 


Math Skills for Daily Living. Dadmals 


• 


Danoyar-Gappart 




6*8 


Math Skills for Daily Living, Ratio. 
Proportion, and Parcant 


• 


Danoyar-Gappart 




6*8 


Basic Math. Taachac a Annotatad 

Edition 


• 


Random 
Housa/McCormick- 
Mathars 




10-11 


Intagratad Mathamatics 


Drassisr & Kaanan 


Am sco 


1989 



'Not providad by projact 
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APPENDIX A 
Instructional material, cont'd 
Science 



Grada 


Titfr 


Author I Publishar | 


Data of Publication 


7 


Biology of Plant & Animals 


Kailay 


Quarcus Corp. 


1984 


7 


RCT Sciaoca Raviaw iii 


Bowna 


nyc Board of eduction 


1985 


6-8 


Entasis tn la Ciancia. Oranga, 
Biua. Graan 


Sund 


Charlas E. Msrill 


1985 


6-8 


Addison-Waslay Sciaoca 


Rockcastla 


Addison-Waslay 


1984 


7 


Biology Workshop, 
Undarstanding Living Things 


Rosan 


Gioba 


1988 


6 


Natural Scianca 


Dapartmant of 

Education 


Rapubiic of China. 
Taiwan 


1992 


7 


Ufa Scianca 


Dapartmant of 

Education 


Naw York City Board of 
Education 


1992 


8 


Earth Scianca 


Dap. of Education 


Marriii Publishing Co. 


1992 


6-8 


Chinasa Suppiamantal & Taxt 

for Bloloov 


S award Park High 
School, Chinasa 
Bilingual Program 


Msrriii Publishing Co. 


1992 


6-8 


Los Saras Viviantaa, Ciancia 7 


* 


Marriii Publishing Co. 


* 


6-8 


La mataria y ia anargia, 

Ciancia 8 


* 


Edicionaa SM 


* 


A_A 


lb poiucion aa 10a maras 


Tony Hara 


Edicionaa SM 




A.A 


LA llUVTa CkCKja 


Tony Hara 


Edicionas SM 






lo» ocaanoa 


Lucy Bakar 


Edicionaa SM 




£ o 

o-o 


La das truce ion da loa habitats 


Tony Hara 


Edicionaa SM 




6-8 


Latiarra 


Riasco y Lop az 


Editorial Bruno 




6-8 


La alactricidad 


Riasco y Lopsz 


Editorial Bruno 




6*8 


E) mundo vagatal 


Marcadas Gomaz 


Editorial Bruno 




6-8 


La mataria 


Riasco y Lopaz 


Editorial Bruno 




6-8 


Fuantaa da anargia 


Hidalgo y Rivillo 


Editorial Bruno 




6-6 


Eeotogta y madto ambianta 


Bac dal Rio 


Editorial Buno 




6-8 


Ffstea carcana 


Ortiz & Santos 


Editorial Bruno 




6-8 


0 cuarpo Humano, 2 


Valaro & Valaro 


Editorial Bruno 
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Instructional material, cont'd 
Science 



Grads 


TitJa 


Author 


Publishar 


Oats of Publication 


6-8 


Introduce ion a las ciancias 


• 


Colaccion Aiinorma 




$.8 


t m\ r Ana ^la nvmtA 

ui c«pa ut oiono 


Tony Hara 


Edicionas SM 




6-8 


Lot rasiduos toxico* 


Tony Hara 


Edicionas SM 




6-6 


Lot dasiartoa 


Lucy Bakar 


Edicionas SM 


* 


6-8 


Lot rasiduos radioactivoa 


Lucy Bakar 


Edicionas SM 






Diccionario llustrado da 
ciancias 


God man 


Editorial Evsrast S.A. 




6-8 


Introduction a las ciancias 
quimicas 


Oiaz Cubaro 


Compariia Cultural 
cat tor a y uisuiouioora 
da Taxtoa Amaricanos, 
SA 




6-6 


Introduce ion a las ciancias 
biologicas 


Diaz Cubaro 


Distribuidora Escolar, 

Inc. 


* 


9 


Biology 


Oxanhorn 


Globa Book Co. 


1974 


10 


Scianca 


Enginaaring: Tarms, 
Tablas, and Skills 


Woodruff 


1966 


10 


Scianca 


Chamistry: Tha Chamical 
World 


Darlington & BganfakJ 


1977 
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Instructional material, cont'd 
Social Studies 



Grada 


Titfo 


Author 


Publiahar 


Data of Publication 


CO 


"*Tiwiv« i nisxory ivmnaaa 
Version) 


Byoungh ya Chang 


Cocn Hum 


1984 


6 


World Geography & You 


Barnstain 


Stack Vaughn Co. 


1986 


7.8 


America's Hifttorv 1 & It 






1986 


7 


Th# Road to Indapandanca 


Ura & Ura 


Globa Book Co. 


1987 


8 


Nuava Historia da loa 
Estado Unidoa 


Bakarak (ad.) 


Minarva Book, Ltd. 


1991 


6-8 


Gtosa/lo Bilingua da 
Estudioa Socialaa/BilinguaJ 
Gloaaary of Social Studiaa 


• 


Naw York City Board of 
Education 


• 


9 


World CuKuraa (Exploring) 


Nawhill & Paglia 


Ginn & Co. 


1986 


12 


Economica (Inatitutiona & 
Analyst) 


Antail 


Amaco 


1987 


6-8 


Com put aft: Programming 
and Applicatlona 


Maiaai 


Scianca Raaaarch 
Aaaociataa 


« 


6-8 


Computar Utaracy Through 
Application* 


Kurshan. Novambar. & 
Stona 


Houghton-Mifflin 


• 


6-8 


MS-DOS 5.0 Gating 
Startad 


« 


NEC 


* 
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Instructional material, cont'd 



Computer Education 



VMlQf 1 


Ttti* 


Author 


Pubiishar j 


Date of Publication 


6-8 


Microsoft Windows 3.1, 
Gatting otartac uuiaa & 
Ussr's Quid* 




NEC 




6-8 


PowarMate SX/20 vi Umf's 
Guida & Quick Start Guida 




NEC 


• 


6-8 


UMr't Guida for tha IBM 
LftMr Printer 


• 


IBM 


• 


6-8 


Getting Started with tha 
IBM LaMr Printer 




IBM 






Technical R*fe r#ncs for tha 
IBM LftMr Printer 




IBM 




6-8 


IBM LaMr Printer Software 
Applications/ 
Drivars IntermsSon 




IBM 




6-8 


Suppl las/Options Catalog 
forthaLatar Printer 4019 
and 4029 lariat Printers 




Addis on-Wat lay 




6-8 


Using Computers. Solutions 
Manual & Taachar's 
Commantary 




Madia Materials, Inc. 




6-8 


Basic Steps to Basic, 
Stud ant Workbook 




EDC Publishing 




6-8 


Practice your Basic, 
Puaias. Tast and Problams 
to Improva your Skills 


Usborna/Hayas 


EDC Publishing 




6-8 


Practical Things to do with 
a Microcomputer 


Usborna/Hayas 


EDC Publishing 




6-8 


Introduction to Computer 
Programming, Basic for 
Baginnara 


Hayas 


• 




6-8 


Undarstanding tha Micro, 
How it Works and What it 
Can Do 


Hay as 


EDC Publishing 




I « 


Computer Jargon 


* 


EDC Publishing 
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APPENDIX C 
Likert Scale 



BILINGUAL, MULTICULTURAL, AND EARLY CHILDHOOD EVALUATION 

OFFICE OF RESEARCH, EVALUATION, AND ASSESSMENT 

NEW YORK PUBLIC SCHOOLS 

110 LIVINGSTON STREET, ROOM 732 

BROOKLYN, N.Y. II 201 

(718) 935-3790 



¥ m h mm . evuuioa mi ah mm«nt 




Staff Awareness 
Spring 1993 



5 5 



Program: Project E.T. 



1 2 



Directions : Please write the numbers that show how you feel in the boxes on the 
right. 



1 . Since participating in Project E.T., to what degree have you become more aware of students' needs? 



□ 



Not more aware 
at all 



Extensively 
aware 



1 2 3 4 5 

Since participating in Project E.T., to what degree have you become more aware of students' problems? 



□ 



Not more aware 
at all 



1 2 3 4 5 



Extensively 
aware 



What is your overall assessment of the project? 



Poor 
quality 



Superior 
quality 



1 2 3 4 5 

List what you consider to be the three most significant needs/problems that students have. 



Thank you very much for your assistance. 
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